Astronomaly: Personalised active anomaly detection in astronomical data
نویسندگان
چکیده
Survey telescopes such as the Vera C. Rubin Observatory and Square Kilometre Array will discover billions of static dynamic astronomical sources. Properly mined, these enormous datasets likely be wellsprings rare or unknown astrophysical phenomena. The challenge is that are so large most data never seen by human eyes; currently robust instrument we have to detect relevant anomalies. Machine learning a useful tool for anomaly detection in this regime. However, it struggles distinguish between interesting anomalies irrelevant instrumental artefacts sources simply not interest particular scientist. Active combines flexibility intuition brain with raw processing power machine learning. By strategically choosing specific objects expert labelling, minimises amount scientists look through while maximising potential scientific return. Here introduce Astronomaly: general framework novel active approach designed provide personalised recommendations. Astronomaly can operate on types data, including images, light curves spectra. We use Galaxy Zoo dataset demonstrate effectiveness Astronomaly, well simulated thoroughly test our new approach. find both datasets, roughly doubles number found first 100 viewed user. easily extendable include feature extraction techniques, algorithms even different approaches. code publicly available at https://github.com/MichelleLochner/astronomaly.
منابع مشابه
Anomaly Detection for Astronomical Data
Modern astronomical observatories can produce massive amount of data that are beyond the capability of the researchers to even take a glance. These scientific observations present both great opportunities and challenges for astronomers and machine learning researchers. In this project we address the problem of detecting anomalies/novelties in these large-scale astronomical data sets. Two types ...
متن کاملOutlier detection in astronomical data
Astronomical data sets have experienced an unprecedented and continuing growth in the volume, quality, and complexity over the past few years, driven by the advances in telescope, detector, and computer technology. Like many other fields, astronomy has become a very data rich science. Information content measured in multiple Terabytes, and even larger, multi Petabyte data sets are on the horizo...
متن کاملActive Anomaly Detection in Heterogeneous Processes
An active inference problem of detecting an anomalous process among M heterogeneous processes is considered. At each time, a subset of processes can be probed. The objective is a sequential probing strategy that dynamically determines which processes to observe at each time and when to terminate the search so that the expected detection time is minimized under a constraint on the probability of...
متن کاملAnomaly Detection in Gps Data
Modern machine learning techniques provide robust approaches for datadriven modeling and critical information extraction, while human experts hold the advantage of possessing high-level intelligence and domain-specific expertise. We combine the power of the two for anomaly detection in GPS data by integrating them through a visualization and human-computer interaction interface. In this thesis ...
متن کاملAnomaly detection in diurnal data
In this paper we present methodological advances in anomaly detection tailored to discover abnormal traffic patterns under the presence of seasonal trends in data. In our setup we impose specific assumptions on the traffic type and nature; our study features VoIP call counts, for which several traces of real data has been used in this study, but the methodology can be applied to any data follow...
متن کاملذخیره در منابع من
با ذخیره ی این منبع در منابع من، دسترسی به آن را برای استفاده های بعدی آسان تر کنید
ژورنال
عنوان ژورنال: Astronomy and Computing
سال: 2021
ISSN: ['2213-1345', '2213-1337']
DOI: https://doi.org/10.1016/j.ascom.2021.100481